Single unit 360-degree camera with an integrated lighting array

ABSTRACT

Methods of creating a 360 degree camera as a single unit with an integrated lighting array are provided. The lighting array is invisible to the camera when acquiring a spherical image. The creating includes selecting a housing for the 360 degree camera, the housing (i) configured to carry the integrated lighting array and (ii) having a plurality of surfaces that includes at least a first outer surface and a second outer surface; and, positioning a plurality of lenses on the housing to collect a plurality of imaging spaces that are stitched together to form the spherical image. In order to keep the lighting array at least substantially invisible to the lenses of the camera, the methods can include defining a plurality of blind spaces, n, each of which includes a blind area on the housing.

BACKGROUND

Field of the Invention

The teachings are directed to a single unit, 360-degree camera with anintegrated lighting array, fixably attached to the camera or removablyattached to the camera, the lighting array being at least substantiallyinvisible to the lens of the camera when taking a spherical image.

Description of the State-of-the-Art

A problem in the art of spherical imaging is obtaining a desired amountof lighting without the lighting apparatus being visible in thespherical image. This is because the additional/sufficient/enhancedlightning that is desired over a scene is hard to achieve because thereis no such thing as “behind the camera” in a panoramic video, forexample.

Current technology uses flooded lighting in the environment in which aspherical image is taken. The problem is that the lighting is ofteninsufficient, and the only solution, currently, is to use an adjacent,independent source of lighting that needs to move independent of thespherical camera, which means the problem still remains that thelighting source is visible to the camera.

One of skill will appreciate having a solution to this problem, namely,a single unit, 360-degree camera with a lighting array, attached to thecamera or integrated with the camera, that is at least substantiallyinvisible to the lens of the camera when taking a spherical image.

SUMMARY

The teachings are directed to a single unit, 360-degree camera with anintegrated lighting array, fixably attached to the camera or removablyattached to the camera, the lighting array being at least substantiallyinvisible to the lens of the camera when taking a spherical image.

More specifically, methods of creating a 360 degree camera as a singleunit with an integrated lighting array that is invisible to the camerawhen acquiring a spherical image are provided herein. In these methods,the creating includes selecting a housing for the 360 degree camera, thehousing (i) configured to carry the integrated lighting array and (ii)having a plurality of surfaces that includes at least a first outersurface and a second outer surface; and, positioning a plurality oflenses on the housing to collect a plurality of imaging spaces that arestitched together to form the spherical image. The plurality of lensescan include a first lens on the first outer surface to collect a firstimaging space and a second lens on the second outer surface to collect asecond imaging space.

A plurality of image sensors are operably connected to the plurality oflenses, each of the plurality of image sensors operably connected to arespective lens in the plurality of lenses, wherein a first image sensoris positioned in the housing behind the first lens and a second imagesensor is positioned in the housing behind the second lens. Since themethods can include various ways of implementing computers, the methodscan include configuring each of the image sensors for operablyconnecting to (i) a circuit that includes a processor and a memory on anon-transitory computer readable storage medium; and, (ii) a powersource. In order to keep the lighting array at least substantiallyinvisible to the lenses of the camera, the methods can include defininga plurality of blind spaces, n, each of which includes a blind area onthe housing, the plurality of blind spaces including (i) a first blindspace that is at least substantially excluded from the plurality ofimaging spaces, the first blind space including a first blind area onthe housing; and, (ii) a second blind space that is at leastsubstantially excluded from the plurality of imaging spaces, the secondblind space including a second blind area on the housing. The methodscan include integrating a plurality of light sources, n-x, where xranges from 0 to (n−2), into the plurality of blind spaces, theintegrating including placing each of the plurality of light sources inone of the plurality of blind spaces such that the plurality of lightsources is at least substantially invisible to the lenses of the camerawhen acquiring the plurality of imaging spaces, the placing includinginstalling a first light source in the first blind area and a secondlight source in the second blind area.

In some embodiments, the methods include operably connecting the circuitthat includes a processor and a memory on a non-transitory computerreadable storage medium to the image sensor. Likewise, in someembodiments, the methods include operably connecting the circuit thatincludes a processor and a memory on a non-transitory computer readablestorage medium to the image sensor; and, a power source.

Consequently, a 360 degree camera having an integrated lighting arraythat is invisible to the camera when acquiring a spherical image is alsoprovided herein. The camera can include a housing having a plurality ofsurfaces that includes at least a first outer surface, and a secondouter surface; and, a plurality of lenses on the housing, the pluralityof lenses configured to collect a plurality of imaging spaces that arestitched together to form the spherical image, the plurality of lensesincluding at least a first lens on the first outer surface and a secondlens on the second outer surface. In these embodiments, the first lenscan be configured to obtain a first image data set corresponding to afirst imaging space and the second lens can be configured to obtain asecond image data set corresponding to a second imaging space.

As discussed in the methods of use, a plurality of image sensors can beoperably connected to the plurality of lenses, each of the plurality ofimage sensors operably connected to a respective lens in the pluralityof lenses, wherein a first image sensor is positioned in the housingbehind the first lens and a second image sensor is positioned in thehousing behind the second lens. Since the methods can include variousways of implementing computers, the methods can include configuring eachof the image sensors for operably connecting to (i) a circuit thatincludes a processor and a memory on a non-transitory computer readablestorage medium; and, (ii) a power source. In order to keep the lightingarray at least substantially invisible to the lenses of the camera, thecameras have a plurality of blind spaces, n, each of which includes ablind area on the housing, the plurality of blind spaces including (i) afirst blind space that is at least substantially excluded from theplurality of imaging spaces, the first blind space including a firstblind area on the housing; and, (ii) a second blind space that is atleast substantially excluded from the plurality of imaging spaces, thesecond blind space including a second blind area on the housing. Themethods can include integrating a plurality of light sources, n-x, wherex ranges from 0 to (n−2), into the plurality of blind spaces, theintegrating including placing each of the plurality of light sources inone of the plurality of blind spaces such that the plurality of lightsources is at least substantially invisible to the camera when acquiringthe plurality of imaging spaces, the placing including installing afirst light source in the first blind area and a second light source inthe second blind area.

In some embodiments, the camera comprises the circuit that includes aprocessor and a memory on a non-transitory computer readable storagemedium to the image sensor. And, in some embodiments, the cameracomprises circuit that includes a processor and a memory on anon-transitory computer readable storage medium to the image sensor;and, a power source.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B illustrate a single unit, 360-degree camera with anintegrated lighting array that is at least substantially invisible tothe camera when taking a spherical image, according to some embodiments.

FIGS. 2A through 2L illustrate various shapes that may be used for acamera housing, according to some embodiments.

FIGS. 3A through 3G illustrate a camera with a cube-shaped camerahousing, lens coverage and creation of blind spaces, and the use of theblind spaces to install, for example, lighting, state selectors,mounting devices, a display, a microphone, and the like, according tosome embodiments.

FIG. 4 shows a general technology platform for the system, according tosome embodiments

FIG. 5 illustrates a processor-memory diagram to describe components ofthe system, according to some embodiments.

FIG. 6 is a concept diagram illustrating the system, according to someembodiments.

FIGS. 7A through 7D illustrate the problem of shadowing due to lightingapparatus that remains visible to a camera while acquiring an image, anda solution to the problem, according to some embodiments.

FIGS. 8A through 8D illustrate the problem of hot spots and cold spotsdue to lighting that overlaps and is visible to the camera whileacquiring an image, and a solution to the problem, according to someembodiments.

FIGS. 9A through 9C illustrate cuboctahedron camera housing shapes,according to some embodiments.

FIGS. 10A through 10H illustrate camera and lighting arrayconfigurations that can be used with the snub cuboctahedron, accordingto some embodiments.

FIG. 11 illustrates a processor-memory diagram to describe components ofthe peripheral computer control system, according to some embodiments.

FIG. 12 is an operational flowchart for a single unit, 360-degree camerawith an integrated lighting array that is at least substantiallyinvisible to the camera when taking a spherical image, according to someembodiments.

FIGS. 13A and 13B illustrate the miniaturization of a 360-degree camerausing the camera configurations taught herein, according to someembodiments.

FIG. 14 illustrates how a network may be used for a single unit,360-degree camera with an integrated lighting array that is at leastsubstantially invisible to the camera when taking a spherical image,according to some embodiments.

DETAILED DESCRIPTION

The teachings are directed to a single unit, 360-degree camera with anintegrated lighting array, fixably attached to the camera or removablyattached to the camera, the lighting array being at least substantiallyinvisible to the lens of the camera when taking a spherical image. Insome embodiments, the image can be a “still” image. In some embodiments,the image can be a video image. And, in some embodiments, the image canbe a combination of still and video images.

One of skill will appreciate that the term “integrated” refers to theparts of the methods, systems, and devices taught herein being linked orcoordinated. For example, the lighting arrays are integrated with the360-degree cameras taught herein because they are coordinated with theplurality of lenses on the camera. Such integrated lighting arrays canbe fixably connected to the cameras taught herein, or they can beremovable. One of skill will appreciate that the phrase substantially”,as used herein, refers to an object being “at least substantiallyinvisible” to the lens of a camera, or “at least substantially excluded”from the field of view of lens, for example. As such, the phrase isreferring to either completely excluding an object from an imageobtained by the camera by placing it in a blind space, as taught herein,or excluding the object to a great degree, such that the object can beremoved in the process of assembling the image, referred to as“stitching” in some embodiments. The phrase is also used to teach “Thecomputer processor and memory can be at least substantially entirelycontained in the 360-degree camera, near the periphery”, which will beunderstood by those of skill as meaning the processor and memory arebrought at or near the surface of the periphery of the 360-degree camerato increase cooling and decrease size of the camera. In someembodiments, these components are either contained below the surface ormainly below the surface, although some of the components may bepalpable at the surface of the device. Likewise, one of skill willunderstand the term “about” to mean that the method, system, or devicecan vary from the amount taught as long as the deviation does not createa noticeable change in the desired effect, function, or performance fromthe amount taught.

FIGS. 1A and 1B illustrate a single unit, 360-degree camera with anintegrated lighting array that is at least substantially invisible tothe camera when taking a spherical image, according to some embodiments.Methods of creating the 360 degree camera are provided herein. In thesemethods, the creating includes selecting a housing 105 for the 360degree camera 100, the housing 105 (i) configured to carry an integratedlighting array 110,115 and (ii) having a plurality of surfaces 120,125that includes at least a first outer surface 120 and a second outersurface 125; and, positioning a plurality of lenses 120L,125L on thehousing 105 to collect a plurality of imaging spaces 130,135 that arestitched together to form a spherical image. The plurality of lenses120L,125L can include a first lens 120 on the first outer surface 120 tocollect a first imaging space 130 and a second lens 125 on the secondouter surface 125 to collect a second imaging space 135.

A plurality of image sensors 140,145 are operably connected to theplurality of lenses 120L,125L, each of the plurality of image sensors140,145 operably connected to a respective lens in the plurality oflenses 120L,125L, wherein a first image sensor 140 is positioned in thehousing 105 behind the first lens 120L and a second image sensor 145 ispositioned in the housing 105 behind the second lens 125L. Since themethods can include various ways of implementing computers, the methodscan include configuring each of the image sensors 140,145 for operablyconnecting to (i) a circuit 150 that includes a processor 155 and amemory 160 on a non-transitory computer readable storage medium; and,(ii) a power source (not shown). In order to keep the lighting array110,115 at least substantially invisible to the lenses 120L,125L of thecamera 100, the methods can include defining a plurality of blind spaces180,190, n, each of which includes a blind area 185,195 on the housing105, the plurality of blind spaces 180,190 including (i) a first blindspace 180 that is at least substantially excluded from the plurality ofimaging spaces 130,135, the first blind space 180 including a firstblind area 185 on the housing 105; and, (ii) a second blind space 190that is at least substantially excluded from the plurality of imagingspaces 130,135, the second blind space 190 including a second blind area195 on the housing 105. The methods can include integrating a pluralityof light sources 110,115, n-x, where x ranges from 0 to (n−2), into theplurality of blind spaces 180,190, the integrating including placingeach of the plurality of light sources 110,115 in one of the pluralityof blind spaces 180,190 such that the plurality of light sources 110,115is at least substantially invisible to the camera 100 when acquiring theplurality of imaging spaces 130,135, the placing including installing afirst light source 110 in the first blind area 185 and a second lightsource 115 in the second blind area 195.

In some embodiments, the methods include operably connecting the circuit150 that includes the processor 155 and the memory 160 on thenon-transitory computer readable storage medium to the image sensor140,145. Likewise, in some embodiments, the methods include operablyconnecting the circuit 150 that includes the processor 155 and thememory 160 on a non-transitory computer readable storage medium to theimage sensor 140,145; and, a power source (not shown). And, in someembodiments, the memory 160 includes an image processing engine (DSP)165 and data storage 170.

Consequently, a 360 degree camera having an integrated lighting arraythat is invisible to the camera when acquiring a spherical image is alsoprovided herein. The camera can include a housing having a plurality ofsurfaces that includes at least a first outer surface, and a secondouter surface; and, a plurality of lenses on the housing, the pluralityof lenses configured to collect a plurality of imaging spaces that arestitched together to form the spherical image, the plurality of lensesincluding at least a first lens on the first outer surface and a secondlens on the second outer surface. In these embodiments, the first lenscan be configured to obtain a first image data set corresponding to afirst imaging space and the second lens can be configured to obtain asecond image data set corresponding to a second imaging space.

It should be appreciated by those of skill that the camera housing needsto be configured such that there are at least two sides of the camerathat are at least substantially invisible to at least two lensesconfigured to capture a 360 degree image. As such, there are numerouscamera housing shapes that are possible, virtually infinite in theory.For example, in some embodiments, a camera housing having up to 50sides, 40 sides, 30 sides, 20 sides, 10 sides, 4 sides, or any number ofsides therein in increments of 1 side, can be used. In fact, in someembodiments, the housing is a 4-sided polyhedron, a 6-sided polyhedron,an 8-sided polyhedron, a 12-sided polyhedron, or a 20-sided polyhedron.In fact, in some embodiments, the housing is a cuboctahedron, or a snubcuboctahedron. And, in some embodiments, the housing is a cylinder or asphere.

FIGS. 2A through 2L illustrate various shapes that may be used for acamera housing, according to some embodiments. The shape of the cameracan be determined by the number of lenses we want to use in the camera.FIG. 2A illustrates a 4-sided polyhedron with 4 vertices that could eachserve as a blind area for placement of a light, a mounting device, orother component that can be kept at least substantially invisible to thelenses of the camera. FIGS. 2B and 2D illustrate 5-sided polyhedrons,FIG. 2B showing a 5-sided polyhedron with 5 such vertices, and FIG. 2D,on the other hand, offering 6 such vertices. FIG. 2E illustrates a6-sided polyhedron with 8 such vertices. FIG. 2F illustrates apolyhedron an 8-sided polyhedron with 12 such vertices. FIG. 2Gillustrates a 12-sided polyhedron with 20 such vertices. FIG. 2Hillustrates a 20-sided polyhedron with only 12 vertices. FIG. 2Iillustrates a polyhedron, possibly a modified form of FIG. 2E, whereinthe 8 vertices have been countersunk or recessed to a desired shape, toaccept the insertion of any of a variety of components into the blindareas. FIG. 2J is an example of a shape that has only one vertex butincludes many other opportunities to place components where they can bekept at least substantially invisible to the lenses of the camera suchas, for example, by placing them in a blind area anywhere around thecircumference of the circular side of the polyhedron of FIG. 2J. FIG. 2Kshows no vertex but plenty of blind areas anywhere around eithercircumference of either circular side of the polyhedron. FIG. 2L istechnically not a polyhedron, but it is included as a desirable shape,as one of skill will recognize that there are several lensconfigurations having the potential of plenty of blind areas anywherearound the sphere.

In some embodiments, a suitable panoramic video can be obtained withminimum of two lenses, placed back-to-back, and with angle of view atleast 180-degrees each. In some embodiments, a multiple-lens solutioncan use a pyramid-shaped camera housing for 4-lens configuration and, insome embodiments, a cube-shaped camera housing can be used for a 6-lensconfiguration. Any number of lenses can be used. In some embodiments,the camera can be configured with 2 lenses, 3 lenses, 4 lenses, 5lenses, 6 lenses, 7 lenses, 8 lenses, 9 lenses, 10 lenses, 11 lenses, 12lenses, 13 lenses, 14 lenses, 15 lenses, 16 lenses, 17 lenses, 18lenses, 19 lenses, or 20 lenses.

One of skill should appreciate that, in any of the embodiments taughtherein, components added into one or more blind areas can beindependently select, alone or in combination, for example, to includeone or more (i) lights; (ii) light sensors; (iii) mounting hardware ordevices; (iv) computer hardware including, for example, processor,memory; (v) input/output ports; (vi) speaker/microphone; (vii) stateselectors; (viii) video/LED screen graphical interface; (ix)W-Fi/Bluetooth; (x) a power source; and the like.

In some embodiments, the angle-of-view, or field-of-view, of the lensescan be set at a desired percentage, adjusted for the shape of thehousing, and one lens per side can be used. Such a configuration designsa blind space at each corner between the lenses. In some embodiments,for example, the design would create 4 blind spaces in a pyramid-shapedhousing, 8 blind spaces in a cube-shaped housing, and so on. One ofskill in the art of acquiring images and designing cameras willappreciate that the lenses can be independently selected and/or designedfor the camera, or for particular positions on the camera.

One of skill will appreciate that several angles-of-view can beimplemented, and selected independently, when selecting and placing eachof the plurality of lenses around the 360 degree camera. For comparisonto the selection of an angle-of-view for the camera's taught herein, thehuman eye provides us with a perceived angle-of-view of about 140° by80° In some embodiments, the lens of the camera can be a fisheye lenswith an angle of view that can range, for example, from about 114° toabout 180° or greater. In some embodiments, the lens can be an ultrawideangle lens with an angle of view that can range, for example, from about84° to about 114°. In some embodiments, the lens can be a wide anglelens with an angle of view that can range, for example, from about 64°to about 84°. In some embodiments, the lens can be a normal or standardangle lens with an angle of view that can range, for example, from about40° to about 62°. In some embodiments, the lens can be a long focus lenswith an angle of view that can range, for example, from about 0.5° toabout 35°, where a medium telephoto lens ranges from about 10° to about30°, and a super telephoto lens ranges from about 0.5° to about 8°.

Likewise, in some embodiments, the lens can be a fisheye lens with afocal length that can range, for example, from about 8 mm to about 10 mmfor a circular image and about 15 mm to about 16 mm for a full-frameimage. In some embodiments, the lens can be an ultrawide angle lens witha focal length that can range, for example, from about 14 mm to about 24mm. In some embodiments, the lens can be a wide angle lens with a focallength that can range, for example, from about 24 mm to about 35 mm. Insome embodiments, the lens can be a normal or standard angle lens with afocal length that can range, for example, from about 36 mm to about 60mm. In some embodiments, the lens can be a long focus lens with a focallength that can range, for example, from about 85 mm to about 300 mm orgreater, where a medium telephoto lens ranges from about 85 mm to about135 mm, and a super telephoto lens can be, for example about 300 mm,ranging from about 135 mm to about 300 mm or greater. In someembodiments, the focal length can be about 2 mm, about 12 mm, about 14mm, about 16 mm, about 20 mm, about 24 mm, about 35 mm, about 50 mm,about 70 mm, about 85 mm, about 105 mm, about 200 mm, about 300 mm,about 400 mm, about 500 mm, about 600 mm, about 700 mm, about 800 mm,about 1200 mm, or any focal length therein in increments of 1 mm.

A plurality of image sensors are operably connected to the plurality oflenses, each of the plurality of image sensors operably connected to arespective lens in the plurality of lenses, wherein a first image sensoris positioned in the housing behind the first lens and a second imagesensor is positioned in the housing behind the second lens. One of skillin the art of acquiring images and designing cameras will appreciatethat the image sensors can be independently selected and/or designed forthe camera, or for particular positions on the camera. The image sensorformat is the shape and size of the image sensor.

The image sensor format, or optical format, can be selected to determinethe angle-of-view of a particular lens. The following table providesexamples of optical formats that may be used with the methods andsystems taught herein:

Diagonal Width Height Area Stops Crop Sensor Type (mm) (mm) (mm) (mm²)(area) factor^([32]) 1/10″ 1.60 1.28 0.96 1.23 −9.51 27.04 1/8″ 2.001.60 1.20 1.92 −8.81 21.65 1/6″ (Panasonic SDR-H20, SDR- 3.00 2.40 1.804.32 −7.64 14.14 H200) 1/4″ 4.00 3.20 2.40 7.68 −6.81 10.81 1/3.6″(Nokia Lumia 720)¹ 5.00 4.00 3.00 12.0 −6.16 8.65 1/3.2″ (iPhone 5) 5.684.54 3.42 15.50 −5.80 7.61 Standard 8 mm film frame 5.94 4.8 3.5 16.8−5.73 7.28 1/3″ (iPhone 5S, iPhone 6) 6.00 4.80 3.60 17.30 −5.64 7.211/2.7″ 6.72 5.37 4.04 21.70 −5.31 6.44 Super 8 mm film frame 7.04 5.794.01 23.22 −5.24 6.15 1/2.5″ (Nokia Lumia 1520, Sony 7.18 5.76 4.2924.70 −5.12 6.02 Cyber-shot DSC-T5) 1/2.3″ (Pentax Q) (Sony Cyber-shot7.66 6.17 4.55 28.50 −4.99 5.64 DSC-W330)(gopro hero 3) (PanasonicHX-A500) 1/2.3″ (Sony Exmor IMX220) 7.87 6.30 4.72 29.73 −4.91 5.49 1/2″(Fujifilm HS30EXR) (Espros EPC 8.00 6.40 4.80 30.70 −4.87 5.41 660)1/1.8″ (Nokia N8) (Olympus C-5050, 8.93 7.18 5.32 38.20 −4.50 4.84C-5060, C-7070) 1/1.7″ (Pentax Q7, Canon G10, G15) 9.50 7.60 5.70 43.30−4.32 4.55 1/1.6″ 10.07 8.08 6.01 48.56 −4.15 4.30 2/3″ (Nokia Lumia1020, Fujifilm X-S1, 11.00 8.80 6.60 58.10 −3.89 3.93 X20, XF1) Standard16 mm film frame 12.7 10.26 7.49 76.85 −3.49 3.41 1/1.2″ (Nokia 808PureView) 13.33 10.67 8.00 85.33 −3.34 3.24 Blackmagic Pocket CinemaCamera & 14.32 12.48 7.02 87.6 −3.30 3.02 Blackmagic Studio Camera Super16 mm film frame 14.54 12.52 7.41 92.80 −3.22 2.97 1″ Sony RX100 andRX10, Nikon CX, 15.86 13.20 8.80 116 −2.90 2.72 Samsung NX Mini 1″Digital Bolex d16 16.00 12.80 9.60 123 −2.81 2.70 Blackmagic CinemaCamera EF 18.13 15.81 8.88 140 −2.62 2.38 Four Thirds, Micro Four Thirds(“4/3”, 21.60 17.30 13 225 −1.94 2.00 “m4/3”) Blackmagic Production24.23 21.12 11.88 251 −1.78 1 1.79 Camera/URSA/URSA Mini 4K 1.5″ CanonPowerShot G1 X Mark II 23.36 18.70 14 262 −1.72 1.85 “35 mm” 2 PerfTechniscope 23.85 21.95 9.35 205.23 N/A N/A original Sigma Foveon X324.90 20.70 13.80 286 −1.60 1.74 “Super 35 mm” 2 Perf 26.58 9.35 24.89232.7 N/A N/A Canon EF-S, APS-C 26.82 22.30 14.90 332 −1.39 1.61Standard 35 mm film frame 27.20 22.0 16.0 352 −1.34 1.59 BlackmagicURSA/URSA Mini 4.6 28.20 25.34 14.25 361 −1.23 1.53 APS-C (Sony α DT,Sony E, Nikon 28.2-28.4 23.6-23.7 15.60 368-370 −1.23 1.52-1.54 DX,Pentax K, Samsung NX, Fuji X “35 mm 3 Per” 28.48 24.89 13.86 344.97 N/AN/A Super 35 mm film 4 Perf 31.11 24.89 18.66 464 −0.95 1.39 Canon APS-H33.50 27.90 18.60 519 −0.73 1.29 35 mm full-frame, (Canon EF, Nikon43.1-43.3 35.8-36 23.9-24 856-864 0 1.0 FX, Sony α, Sony FE, Leica M)Leica S 54 45 30 1350 +0.64 0.80 Pentax 645D, Hasselblad X1D-50c 55 4433 1452 +0.75 0.78 Standard 65 mm film frame 57.30 52.48 23.01 1208+0.81 0.76 Kodak KAF 39000 CCD 61.30 49 36.80 1803 +1.06 0.71 Leaf AFi10 66.57 56 36 2016 +1.22 0.65 Medium-format (Hasselblad H5D-60) 67.0853.7 40.2 2159 +1.26 0.65 Phase One P 65+, IQ160, IQ180 67.40 53.9040.40 2178 +1.33 0.64 Medium Format Film 6 × 4.5 70 56 42 2352 +1.660.614 Medium Format Film 6 × 6 79 56 56 3136 +2 0.538 Medium Format Film6 × 7 87 67 56 3752 +2.05 0.505 IMAX film frame 87.91 70.41 52.63 3706+2.05 0.49 Large Format Film 4 × 5 150 121 97 11737 +3.8 0.29 LargeFormat Film 5 × 7 210 178 127 22606 +4.5 0.238 Large Format Film 8 × 10300 254 203 51562 +6 0.143

In some embodiments, the sensor sizes for each lens on the camera can beindependently selected, for example, from sizes that include 10.24mm×5.76 mm, 15 mm×12 mm, 17.8 mm×10 mm, 21.1 mm×11.9 mm, 21.6 mm×13.3mm, 22.18 mm×22.18 mm, 22.5 mm×11.9 mm, 23.04 mm×10.8 mm, 23.4×15.6 mm,23.76 mm×13.37 mm, 23.76 mm×17.82 mm, 24 mm×12.7 mm, 24 mm×18 mm, 24.2mm×12.5 mm, 24.4 mm×13.7 mm, 24.6 mm×13.8 mm, 24.89 mm×16.86 mm, 25.6mm×13.5 mm, 26.2×13.8 mm, 23.6 mm×13.3 mm, 27.7 mm×14.6 mm, 28.17mm×18.13 mm, 30.7 mm×15.8 mm, 34 mm×17.2 mm, 35.8 mm×23.9 mm, 40.96mm×21.60 mm, 52.1 mm×30.5 mm, 54.12 mm×25.58 mm, or any combinationthereof. In some embodiments, the sensor sizes for each lens on thecamera can be independently selected, for example, from sizes thatinclude 15.81 mm×8.88 mm CMOS, 12.48 mm×7.02 mm CMOS, 21.12 mm×11.88 mmCMOS, 25.34 mm×14.25 mm CMOS, 12.85 mm×9.64 mm CCD, or any combinationthereof. In some embodiments, the sensor sizes for each lens on thecamera can be independently selected, for example, from sizes thatinclude ⅔″ CCD×3, ⅔″ CCD.

One of skill will appreciate that the angle-of-view, the focal length,and the sensor format can be selected for each lens on the camera. Insome embodiments, each lens and sensor combination is the same aroundthe camera. In some embodiments, at least one lens and sensorcombination is different from at least one other lens and sensorcombination on the camera. In some embodiments, the method of making thecamera includes independently selecting the lens and sensor combinationfor one or more sides of the camera to create a desired image or set ofimages. In some embodiments, the method of making the camera includesindependently selecting the lighting, lens, and sensor combination forone or more sides of the camera to create a desired image or set ofimages. And, in some embodiments, the method of using the cameraincludes creating a desired image or set of images, video image or stillimage, using the independently selected lens and sensor, in anycombination desired.

Since the methods can include various ways of implementing computers,the methods can include configuring each of the image sensors foroperably connecting to (i) a circuit that includes a processor and amemory on a non-transitory computer readable storage medium; and, (ii) apower source. As such, in some embodiments, the method of making thecamera includes independently selecting instructions for executing oneor more programs at one or more image sensors, for one or more sides ofthe camera respectively, to create a desired image or set of images. Insome embodiments, the method of making the camera includes independentlyselecting the computer program, computer program instructions, lighting,lens, and/or sensor combination for one or more sides of the camera tocreate a desired image or set of images. And, in some embodiments, themethod of using the camera includes creating a desired image or set ofimages, video image or still image, using the computer program, computerprogram instructions, lighting, lens, and/or sensor, in any combinationdesired.

In order to keep the lighting array at least substantially invisible tothe lenses of the camera, the cameras have a plurality of blind spaces,n, each of which includes a blind area on the housing, the plurality ofblind spaces including (i) a first blind space that is at leastsubstantially excluded from the plurality of imaging spaces, the firstblind space including a first blind area on the housing; and, (ii) asecond blind space that is at least substantially excluded from theplurality of imaging spaces, the second blind space including a secondblind area on the housing. The methods can include integrating aplurality of light sources, n-x, where x ranges from 0 to (n−2), intothe plurality of blind spaces, the integrating including placing each ofthe plurality of light sources in one of the plurality of blind spacessuch that the plurality of light sources is at least substantiallyinvisible to the camera when acquiring the plurality of imaging spaces,the placing including installing a first light source in the first blindarea and a second light source in the second blind area.

In some embodiments, as described in the methods taught herein, thecamera can comprise the circuit, connected to the image sensor, forexample, the circuit including a processor and a memory on anon-transitory computer readable storage medium. And, in someembodiments, the camera comprises the circuit, connected to the imagesensor, for example, that includes a processor and a memory on anon-transitory computer readable storage medium; and, a power source.

FIGS. 3A through 3G illustrate a camera with a cube-shaped camerahousing, lens coverage and creation of blind spaces, and the use of theblind spaces to install any of a number of components such as, forexample, one or more (i) lights; (ii) light sensors; (iii) mountinghardware or devices; (iv) computer hardware including, for example,processor, memory; (v) input/output ports; (vi) speaker/microphone;(vii) state selectors; (viii) video/LED screen graphical interface; (ix)W-Fi/Bluetooth; (x) a power source; and the like.

FIG. 3A illustrates the camera 300, a configuration of the lens, and adisplay of the lens coverage. FIG. 3B shows a blind spot that existsoutside of the lens coverage, between the overlapping lens coverage ofadjacent lenses. FIG. 3C shows how there are 8 blind spots for thisparticular camera configuration, one at each vertex of the cube-shapedhousing (one is not shown). FIG. 3D provides an illustration of theshape of the blind space volume that could contain an object that wouldbe outside the scope of coverage of each lens after the overlap. FIG. 3Eshows that, for example, the blind space could be used to place a light,or a control knob (state selector), which would not be seen in aspherical image taken by the camera 300. FIG. 3F illustrates how otherdevices could be installed in such a blind space such as, for example, amounting device in a mounting hole. Such a device would likely leave anobject within the overlap of one or more lens coverage areas, but suchan object would be at least substantially invisible to the camera,meaning that what remains can be removed from the image in the processof assembling the image data. In some embodiments, the process ofassembling the image data can be referred to as “stitching”, which is aprocess that is well known to those skilled in the art. FIG. 3Gillustrates other ways in which the blind space can be used such as, forexample, to install a graphical display (LCD, LED, etc), a port forconnecting to a peripheral device, state selectors (knob, button, etc),or perhaps an audio device such as a microphone, speaker, etc.

One of skill will appreciate how the use of the blind spaces betweenlens coverages can be used to place components on the periphery of thecamera rather than the inside of the camera, thereby reducing the sizeof the camera, allowing for better heat displacement, better functionalutility with regard to lighting, audio (microphone, speaker, etc),mounting, ports for connections, and the like. Lighting is of particularinterest, as no 360-degree camera on the market today has solved theproblem of lighting. In some embodiments, the lighting that is placed inthe blind spaces can be a cool lighting such as, for example, LEDlighting. In some embodiments, the illumination can be adjustable, forexample, across all lights, lights per side, and/or each individuallight. In some embodiments, the camera can include light sensors whichprovide feedback that allows the camera to adjust lighting automaticallyand, in some embodiments, dynamically. In some embodiments, the lightingcan be used as a source of a flash across all lights, lights per side,and/or each individual light. In some embodiments, the lighting effectsand controls can be operated through an external tethered device and/orany wired or wireless connection. Any and all lighting effects known tothe art could be obtained at the source of image acquisition, thecamera, rather than from a source that is visible to the lenses of thecamera.

Placing and moving the camera in a manner that is at least substantiallyinvisible to the camera presents its own problems with state-of-the-artdevices. In some embodiments, one or more blind spaces can be used as amounting hole for any accessory, such as a stand for a rigid mount thatcan be still or moveable, an eyelet for a wire that can be used as astill mechanism or transit device, an electric component that attachesto other mechanical means to move the camera, wheels or pulleys toassist in placing the camera, and the like. As noted above, in someembodiments, some of these accessories can be at least substantiallyinvisible, meaning that part of it may breach the blind space and becomevisible, but only to a limited extent, such that it extends from a blindspace into an imaging space where imaging is overlapping, and thevisible structure can be removed during the assembly of the image. Insome embodiments, the assembly includes “stitching” of the images, andthis is where the part of the object that enters the spherical imagespace can be removed.

One of skill will appreciate that the amount and placement ofillumination can vary according to the environment in which the image istaken, and the look and feel that is being sought in the image. Thecameras taught herein provide a great deal of flexibility in the amountand placement of the lights, as the shape of the camera housing can varytremendously, and the shape can be used to provide the versatilitysought in taking the image. In some embodiments, the number of lightsthat can be installed on the camera is equal to the number of blindspaces, n, minus one space, or (n−1), to allow for at least a singlemount to hold and/or carry the camera.

FIG. 4 shows a general technology platform for the system, according tosome embodiments. The computer system 400 may be a conventional computersystem and includes a computer 405, I/O devices 450, and a displaydevice 455. The computer 405 can include a processor 420, acommunications interface 425, memory 430, display controller 435,non-volatile storage 440, and I/O controller 445. The computer system400 may be coupled to or include the I/O devices 450 and display device455.

The computer 405 interfaces to external systems through thecommunications interface 425, which may include a DSL modem, cablemodem, ISDN modem, satellite transmission, or any other networkinterface. It will be appreciated that the communications interface 425can be considered to be part of the computer system 400 or a part of thecomputer 405. The communications interface 425 can be any interface forcoupling the computer system 400 to other computer systems, including acellular network, some form of cabled interface, radio interface, or acabled or cradled interface, for example. In a personal digitalassistant, the communications interface 425 typically includes a cradledor cabled interface and may also include some form of radio interface,such as a BLUETOOTH or 802.11 interface, or a cellular radio interface,for example.

The processor 420 may be, for example, any suitable processor, such as aconventional microprocessor including, but not limited to, an 8-bit,16-bit, 32-bit, 64-bit, 128-bit, 256-bit design, for example. Examplesinclude any suitable Intel and AMD processors. Intel Pentiummicroprocessors, a Texas Instruments microprocessors, an RISC processor,a multicore processor, or a combination thereof. The memory 430 iscoupled to the processor 420 by a bus. The memory 430 can be dynamicrandom access memory (DRAM) and can also include static ram (SRAM). Thebus couples the processor 420 to the memory 430, also to thenon-volatile storage 440, to the display controller 435, and to the I/Ocontroller 445. In some embodiments, an ADI chipset can be used.

The I/O devices 450 can include a keyboard, disk drives, printers, ascanner, and other input and output devices, including a mouse or otherpointing device. The display controller 435 may control in theconventional manner a display on the display device 455, which can be,for example, a cathode ray tube (CRT), liquid crystal display (LCD),light-emitting diode (LED), or organic light-emitting diode OLED. Thedisplay controller 435 and the I/O controller 445 can be implementedwith conventional well known technology, meaning that they may beintegrated together, for example.

The non-volatile storage 440 is often a FLASH memory or read-onlymemory, or some combination of the two. A magnetic hard disk, an opticaldisk, or another form of storage for large amounts of data may also beused in some embodiments, although the form factors for such devicestypically preclude installation as a permanent component in somedevices. Rather, a mass storage device on another computer is typicallyused in conjunction with the more limited storage of some devices. Someof this data is often written, by a direct memory access process, intomemory 430 during execution of software in the computer 405. One ofskill in the art will immediately recognize that the terms“machine-readable medium” or “computer-readable medium” includes anytype of storage device that is accessible by the processor 420 and alsoencompasses a carrier wave that encodes a data. Objects, methods, inlinecaches, cache states and other object-oriented components may be storedin the non-volatile storage 440, or written into memory 430 duringexecution of, for example, an object-oriented software program.

The computer system 400 is one example of many possible differentarchitectures. For example, personal computers based on an Intelmicroprocessor often have multiple buses, one of which can be an I/O busfor the peripherals and one that directly connects the processor 420 andthe memory 430 (often referred to as a memory bus). The buses areconnected together through bridge components that perform any necessarytranslation due to differing bus protocols.

In addition, the computer system 400 can be controlled by operatingsystem software which includes a file management system, such as a diskoperating system, which is part of the operating system software. Oneexample of an operating system software with its associated filemanagement system software is the family of operating systems known asWINDOWS from Microsoft Corporation of Redmond, Wash., and theirassociated file management systems. Another example of operating systemsoftware with its associated file management system software is theLINUX operating system and its associated file management system.Another example of an operating system is an ANDROID, or perhaps an iOS,operating system. The file management system is typically stored in thenon-volatile storage 440 and causes the processor 420 to execute thevarious acts required by the operating system to input and output dataand to store data in memory, including storing files on the non-volatilestorage 440. Other operating systems may be provided by makers ofdevices, and those operating systems typically will have device-specificfeatures which are not part of similar operating systems on similardevices. Similarly, it is conceivable that any operating may be adaptedto specific devices for specific device capabilities for the utilitiesprovided herein.

The computer system 400 may be integrated, for example, onto a singlechip or set of chips in some embodiments, and can be fitted into a smallform factor for use as a personal device. Thus, it is not uncommon for aprocessor, bus, onboard memory, and display/I-O controllers to all beintegrated onto a single chip. Alternatively, functions may be splitinto several chips with point-to-point interconnection, causing the busto be logically apparent but not physically obvious from inspection ofeither the actual device or related schematics.

FIG. 5 illustrates a processor-memory diagram to describe components ofthe system, according to some embodiments. The system 500 contains aprocessor 505 and a memory 510 (that can include non-volatile memory),wherein the memory 510 includes a database 515, a transformation system525, and an output subsystem 530. The system can also have a receivingsubsystem 535 on a non-transitory computer readable medium for receivinga set of user-selected output lighting instructions from a peripheraldevice, the receiving subsystem 535 operably connected to the databasefor storing the set of user-selected output lighting instructions. Theinstructions can be received, for example, through a port for connectinga peripheral device to the computer to receive the set of user-selectedoutput lighting instructions from the peripheral device. The system canalso have a lighting engine 540 on a non-transitory computer readablestorage medium for selecting a set of output lighting instructions froma plurality of sets of output lighting instructions. Moreover, thesystem can further comprise a data exchange subsystem 545 embodied in anon-transitory computer readable medium, wherein the data exchangesubsystem is operable to exchange data with external computer readablemedia. The system can also include a stitching subsystem 550 for asplicing of one set of image data with at least a second set of imagedata to form a spherical image, in some embodiments.

The system includes an input device (not shown) operable to receiveimage-oriented data on a non-transitory computer readable medium.Examples of input devices include a data exchange subsystem operable tointeract with external data formats, voice-recognition software, ahand-held device in communication with the system including, but notlimited to, a microphone, and the like. It should be appreciated thatthe input and output data can be analog or digital.

The database 515 is operable to store image, lighting control, andlighting instruction files for access on a non-transitory computerreadable storage medium. The transformation subsystem 520 is operable totransform a first set of illumination instructions to a preselected setof illumination instructions to create a desired spherical image. One ofskill will also appreciate that the desired illumination can be obtainedby attenuating or boosting lighting intensities to produce desiredspherical image. As such, in some embodiments, a software is includedherein that provides a set of output lighting instructions through atransformation module on a non-transitory computer readable medium forexecuting the set of output lighting instructions. The executingincludes transforming the input lighting data set received, for example,from illumination sensors near each of the lens of the camera into astructured output lighting profile using the set of output lightinginstructions.

As described above, the system can include an output subsystem 535embodied in a non-transitory computer readable medium. The outputsubsystem 535 can be operable, for example, to transmit lighting data toan output device, such as a set of lights or lighting array, aperipheral device, or a graphical user interface, for example, which canoptionally be supported by the output subsystem 530.

As described above, the system can further comprise a data exchangesubsystem 545 embodied in a non-transitory computer readable medium,wherein the data exchange subsystem is operable to exchange data withexternal computer readable media, such as to share image data. The dataexchange subsystem 545 can, for example, also serve as a messagingmodule operable to allow users to communicate with other users. Theusers can email one another, post blogs, have instant messagingcapability, or audiovisual conferencing, for real-time communications.In some embodiments, in which the users have video and audio capabilityin the communications, the system implements data streaming methodsknown to those of skill in the art. In some embodiments, the system iscontained in a hand-held device; operable to function as a particularmachine or apparatus having the additional function oftelecommunications, word processing, or the like; or operable tofunction as a particular machine or apparatus not having othersubstantial functions.

The system 500 can also have an output subsystem embodied in anon-transitory computer readable medium, wherein the output subsystemcan be operable to transmit image data, including audiovisual data and,in some embodiments, image data, still or video imaging, includingaudiovisual data, to an output device. Moreover, the system 500 caninclude a user control interface (not shown).

The systems taught herein can be practiced with a variety of systemconfigurations, including personal computers, multiprocessor systems,microprocessor-based or programmable consumer electronics, network PCs,minicomputers, mainframe computers, and the like. The teachings providedherein can also be practiced in distributed computing environments wheretasks are performed by remote processing devices that are linked througha communications network. As such, in some embodiments, the systemfurther comprises an external computer connection through the dataexchange module 545 and a browser program subsystem (not shown). Thebrowser program subsystem (not shown) can be operable to access externaldata as a part of the data exchange subsystem 545.

FIG. 6 is a concept diagram illustrating the system, according to someembodiments. The system 600 contains components that can be used in atypical embodiment. In addition to the database 415, the transformationsubsystem 425, and the output subsystem 430 shown in FIG. 5, the memoryof the device 600 also includes a data exchange subsystem 545 and thebrowser program subsystem (not shown) for accessing the external data.The system can also have a receiving subsystem 535 on a non-transitorycomputer readable medium for receiving a set of user-selected outputlighting instructions from a peripheral device, the receiving subsystem535 operably connected to the database for storing the set ofuser-selected output lighting instructions. The instructions can bereceived, for example, through a port for connecting a peripheral device633 to the computer to receive the set of user-selected output lightinginstructions from the peripheral device 633. The system can also have aselection engine 540 on a non-transitory computer readable storagemedium for selecting a set of output lighting instructions from aplurality of sets of output lighting instructions. As described above,the stitching subsystem 550 is operable for the stitching of the imagedata from each of the cameras on the 360-degree camera into a sphericalimage. Of course, the system can also have a speaker 652, display 653,and microphone 654 connected directly or through I/O device 650, whichis connected to I/O backplane 640.

The system 600 can be implemented in a stand-alone device, a computersystem, or network. In FIG. 6, for example, the I/O device 650 connectsto the speaker 652, display 653, and microphone 654, but could also becoupled to other features. Such a device can have a variety of stateselectors such as, for example, a transformation state selector (TS) 641as a manual control of lighting output, an amplifier state selector (AS)642 to amplifier the power distributed among the lighting array, anequalizer state selector (EQS) 643 to equalize the lighting distributionin an effort to remove hot and cold spots, a regional state selector(RS) 644 to select light regions for control around the 360-degreecamera, a special placement state selector (SPS) 645 to select regionsthat are not controlled by the control program but, rather, arecontrolled only manually, a background state selector (BS) 648 to allowfor control over the background (ambient) lighting effect on the controlprogram, a volume state selector (VS) 647 for the speaker, and a balance(LRS) state selector for controlling lighting on one side of the360-degree camera relative to the opposing side to provide additionalcontrol over ambient lighting effects; wherein, each state selectorconnected directly to the I/O backplane 640.

In some embodiments, the system further comprises security measures toprotect privacy and the integrity of data. Such security measures arethose well-known in the art such as firewalls, data encryption, anti-spysoftware, and the like. In addition, the system can be configured foruse in an environment that requires administrative procedures andcontrol. For example, the system can include an administrative module(not shown) operable to control access, configure the engines, andperform quality assurance tests. The security measures allow the systemsand methods taught herein to be safely used in a network environment.

In some embodiments, the system is a web enabled application and canuse, for example, Hypertext Transfer Protocol (HTTP) and HypertextTransfer Protocol over Secure Socket Layer (HTTPS). These protocolsprovide a rich experience for the end user by utilizing web 2.0technologies, such as AJAX, Macromedia Flash, etc. In some embodiments,the system is compatible with Internet Browsers, such as InternetExplorer, Mozilla Firefox, Opera, Safari, etc. In some embodiments, thesystem is compatible with mobile devices having full HTTP/HTTPS support,such as iPhone, PocketPCs, Microsoft Surface, Video Gaming Consoles, andthe like. In some embodiments, the system can be accessed using anywireless application protocol (WAP). By way of example, such protocolscan serve non HTTP enabled mobile devices such as, for examples, deviceslike cell phones, BlackBerries, Droids, etc., and provides a simpleinterface. Due to protocol limitations, the Flash animations aredisabled and replaced with Text/Graphic menus. In some embodiments, thesystem can be accessed using a Simple Object Access Protocol (SOAP) andExtensible Markup Language (XML). By exposing the data via SOAP and XML,the system provides flexibility for third party and customizedapplications to query and interact with the system's core databases. Forexample, custom applications could be developed to run natively oniPhones using the iPhone Operating System, Java or .Net-enabledplatforms, Android operating system devices, Windows operating systemdevices, etc. One of skill will appreciate that the system is notlimited to any of the platforms discussed above and will be amenable tonew platforms as they develop.

EXAMPLES Example 1. The Problem of Shadowing

The systems, methods, and devices herein address the problem ofshadowing, which is a problem that needed to be overcome in thedevelopment of the technology set-forth herein.

FIGS. 7A through 7D illustrate the problem of shadowing due to lightingapparatus that remains visible to a camera while acquiring an image, anda solution to the problem, according to some embodiments. FIG. 7A showshow a shadow is produced when placing a light next to a lens in or on acamera housing to project the direction of the light in the samedirection in which the lens is acquiring image data. One of skill willappreciate that this problem is exacerbated when trying to create aspherical image from a single camera. FIG. 7B shows how this problem isnot overcome by aligning the lighting source adjacent to the lensitself, as the lens itself will cast a shadow that will be visible inthe final image. FIG. 7C shows how this problem increases with themultiple lenses that can be present with a 360 degree camera, providinga graphical interpretation of why such images will suffer at leastuneven lighting, if not also insufficient lighting, providing a poorimage quality.

FIG. 7D shows how blind spots between lenses can be used to thwart theproblem of shadowing and uneven lighting.

Given the above, one of skill will understand how position of lightingon the periphery of the spherical camera will improve the art ofobtaining spherical images.

Example 2. The Problem of Uneven Lighting

The use of blind spots to thwart the problem of shadowing only begins toaddress the problem of uneven lighting. The overlap of the lightingitself, in the absence of shadowing, can create hot spots which is alsoa source of uneven lighting.

FIGS. 8A through 8D illustrate the problem of hot spots and cold spotsdue to lighting that overlaps and is visible to the camera whileacquiring an image, and a solution to the problem, according to someembodiments. FIG. 8A shows a camera having a housing, lens, and lightingconfiguration that is in agreement with FIG. 7D. FIGS. 8B through 8Dshow how the lighting will overlap and create bright spots, alsoreferred to as “hot spots”. Incidentally, since there are hot spots inareas of lighting overlap, this accentuates the formation of relative“cold spots” at the ends, or edges, of the image acquisition area on theimage sensors due to lack of lighting overlap and fading light intensityof a single light beam at its edge. These overexposed and underexposedregions provide uneven illumination and an image that suffers due to thelighting.

In some embodiments, the camera can be designed with lighting havingdifferent luminosities. In some embodiments, the luminosities areautomatically adjusted by the camera, meaning that the camera can havesoftware that receives luminosity measurements at luminosity sensors,and the power to the light is adjusted to adjust the lumens that aretransmitted by the bulb at that location. In some embodiments, a lighton the camera can have a light output ranging from about 100 lumens toabout 5000 lumens, from about 200 lumens to about 4000 lumens, fromabout 300 lumens to about 3000 lumens, from about 400 lumens to about2800 lumens, from about 450 lumens to about 2600 lumens, or any rangetherein in increments of 10 lumens. In some embodiments, a light on thecamera can have a light output of about 400 lumens, about 500 lumens,about 600 lumens, about 700 lumens, about 800 lumens, about 900 lumens,about 1000 lumens, about 1200 lumens, about 1400 lumens, about 1600lumens, about 1800 lumens, about 2000 lumens, about 2200 lumens, about2400 lumens, about 2600 lumens, about 2800 lumens, about 3000 lumens,about 3200 lumens, about 3400 lumens, about 3600 lumens, about 3800lumens, about 4000 lumens, about 4200 lumens, about 4400 lumens, about4600 lumens, about 4800 lumens, about 5000 lumens, or any luminositytherein in increments of 10 lumens. One of skill will appreciate thateach light can have the same luminosity output potential, or each can beindependently selected to have a luminosity that differs from at leastone other light that is used on the camera. As such, in someembodiments, a lighting array used with a camera taught herein can havean array of lights, each with the same output luminosity. In someembodiments, however, a camera taught herein can have an array oflights, each independently selected to have a luminosity that isdifferent from at least one other light in the array.

In some embodiments, the cameras taught herein can be controlled bysoftware that adjusts luminosity manually, automatically, or acombination of manually and automatically. A manual adjustment can beset using software interface controls or by adjusting one or more stateselectors on the camera. An automatic adjustment can be set by thesoftware taking luminosity measurements from one or more sensors nearthe light that is being adjusted. The lighting for a camera can first beset using an automatic adjustment, and a manual adjust can follow inorder to fine tune the image to one that is desired.

Example 3. A 360-Degree Camera in the Shape of a Snub Cuboctahedron withIntegrated Lighting Array

In addition to the shapes presented herein, there are several otherdesirable shapes that can be configured such that the lighting arraybeing at least substantially invisible to the lens of the camera whentaking a spherical image.

FIGS. 9A through 9C illustrate cuboctahedron camera housing shapes,according to some embodiments. As shown in FIG. 9A, a cuboctahedron is apolyhedron with 8 triangular faces and 6 square faces. The cuboctahedronhas 12 identical vertices, with 2 triangles and 2 squares meeting ateach, and 24 identical edges, each separating a triangle from a square.This configuration provides plenty of opportunity to place a pluralityof lenses, lights, and other desired or necessary components around thecamera housing. The snub cuboctahedron of FIGS. 9B and 9C, however,provides even more opportunity to place a plurality of lenses, lights,and other desired or necessary components around the camera housing. Thesnub cuboctahedron has 38 faces which include 6 squares, 32 equilateraltriangles, 60 edges, and 24 vertices. The snub cuboctahedron is a chiralpolyhedron having two distinct forms which are mirror images (or“enantiomorphs”) of each other, as shown by FIGS. 9B and 9C. A 360degree camera has at least two individual cameras in its housing. Thesnub cuboctahedron housing provides much flexibility in the design of a360 degree camera.

FIGS. 10A through 10H illustrate camera and lighting arrayconfigurations that can be used with the snub cuboctahedron, accordingto some embodiments. FIGS. 10A and 10B show a 360 degree camera 1000having blind areas 1010 near the lenses of its individual cameras 1005that can be used as a place to position components 1015 that are atleast substantially invisible to the lenses of the cameras 1005. FIG.100 shows how a mounting hole can be used to mount any of a variety ofcomponents including one or more (i) lights; (ii) light sensors; (iii)mounting hardware or devices; (iv) computer hardware including, forexample, processor, memory; (v) input/output ports; (vi)speaker/microphone; (vii) state selectors; (viii) video/LED screengraphical interface; (ix) Wi-Fi/Bluetooth; (x) a power source; and thelike. FIG. 10D shows how the component can be a removable light 1025.FIG. 10E shows how the removable light can be placed on the 360 degreecamera as one unit using, for example, a strap 1030 that contains all ofthe lights 1025. FIG. 10F is a view of the strap 1030 alone.

As noted, the components can fixed or removable. FIG. 10G shows how thelights can be added as a fixed unit with the camera. FIG. 10H, on theother hand, shows how the light can be removable, wherein the insertionof the removable light activates a WiFi/Bluetooth transmitter that pairswith a peripheral control computer to control the lighting output on thecamera.

Example 4. Using a Peripheral Computer to Control the Camera

The computer processor and memory can be on, at, or near, the outerperiphery of the 360-degree camera. In fact, in some embodiments, thecomputer processor and memory can be least substantially entirelycontained in the 360-degree camera, near the periphery of the camera, inmany embodiments. However, in some embodiments, it may be desirable toplace a substantial amount of the computer processor and memorycomponents in a peripheral computer to control the camera.

FIG. 11 illustrates a processor-memory diagram to describe components ofthe peripheral computer control system, according to some embodiments.The system 1100 contains a peripheral device processor 1105 and aperipheral device memory 1110 (that can include non-volatile memory),wherein the peripheral device memory 1110 includes a peripheral database1115, a lighting default module 1125, an lighting custom module 1130, aninterface engine 1135, as well as an optional encryption module 1140 toprotect data exchanged, and an optional data exchange module 1145, ofcourse, operable to exchange data with external computer readable media.An output module (not shown) is included to output data.

The instructions can be received, for example, through a port 1009 forconnecting a peripheral device 1011 to receive the set of user-selectedoutput lighting instructions from the peripheral device. The system 1100can also have a selection engine (not shown) for selecting a set ofoutput lighting instructions from a plurality of sets of output lightinginstructions. Each of the modules and engines are on a non-transitorycomputer readable medium.

The system includes an input device (not shown) operable to receivelighting instructions on a non-transitory computer readable medium.Examples of input devices include a data exchange module operable tointeract with external data formats, voice-recognition software, ahand-held device in communication with the system including, but notlimited to, a microphone, and the like. It should be appreciated thatthe input and output can be an analog audio source or digital audiosource.

Example 5. Controlling Lighting Conditions Using the 360-Degree Camerain Manual and/or Automatic Modes

The 360-degree cameras taught herein can be configured to controllighting conditions at each lens either manually, automatically, or byusing a combination of manual and automatic controls. This allows theuser the freedom to set a default lighting level for a particular lookand feel of an image, as well as override the lighting level. In generalterms, the method of controlling lighting output can include, forexample, installing a control program for the lighting system on acomputer, placing the lighting system in pairing mode by turning on thelighting system, and pairing the lighting system to the computer for acontrol of the lighting system through the control program.

FIG. 12 is an operational flowchart for a single unit, 360-degree camerawith an integrated lighting array that is at least substantiallyinvisible to the camera when taking a spherical image, according to someembodiments. The user can first install 1205 a control program on acomputer for pairing with a lighting array on a 360 degree camera. Next,the user can then place 1210 the lighting array in pairing mode and pair1215 the lighting array with the computer for a wireless control of thelighting array. Finally, the user decides whether to use a manuallycontrolled lighting setting, an automatically controlled lightingsetting, or both. For example, the user can manually assess 1220 thedistribution of the lighting from the camera as, or through, an observerand then manually adjust 1225 the distribution of the lighting with thecontrol program using the discretion of the user, or observer. In thealternative, the user can use sensors on the camera to automaticallyassess 1230 the distribution of the lighting through feedback from oneor more sensors on the camera, each camera on the 360-degree camerapotentially having its own sensor. The The 360-degree camera can thenautomatically adjust 1235 the distribution of the lighting with thecontrol program using the sensor feedback and default, or preset,settings. Optionally, the user can then also manually assess 1220 thedistribution of the lighting from the camera as, or through, an observerand then manually adjust 1225 the distribution of the lighting with thecontrol program using the discretion of the user, or observer.

Example 6. Miniaturizing a 360-Degree Camera

It may be desirable to create a 360-degree camera with all componentsarranged in a manner that reduces the cross-sectional diameter of thecamera. For example, cameras with opposing lenses will require across-sectional diameter that allows for the placement of the opposinglens and sensor arrangements on the opposing sides of the camerahousing. In some embodiments, that distance may be reduced by reducingthe distance at which the lens and sensor combinations are placedrelative to one another, such that the minimum distance is that whichallows for adequate heat dissipation from the sensor.

FIGS. 13A through 13B illustrate a configuration for the miniaturizationof a 360-degree camera, according to some embodiments. As described inthe teachings herein, FIG. 13A illustrates how the angle-of-view, thefocal length, and the sensor format can be selected for each lens on thecamera by combining design principles that may be recognized those ofskill with the flexibility of design of the cameras taught herein. Inthese embodiments, the angle-of-view lenses 1320L,1325L, the focallength, and the format of the sensors 1340,1345 can be selected for eachlens on the camera in order to reduce the cross-sectional diameter ofthe housing of the camera, for example, to miniaturize the camera to adesired size. By selecting a desired configuration for the camera thedistance, dSensor, between the image sensors 1340,1345 can be reducedwhile providing adequate dissipation of heat from the image sensors. Insome embodiments, the dissipation of heat can be assisted using anymechanism known to one of skill including, for example, a heat sink, HS,and/or a fan. FIG. 13B illustrates how camera components can be placedat or near the periphery of the housing 1305 in order to reduce thespace required for the volume required to place the components, thusreducing the cross-sectional diameter required to assemble the camera;and, reduce the accumulation of heat in the housing 1305 and increasethe dissipation of any such heat produced from such components. Asdescribed herein, the components can include one or more (i) lights;(ii) light sensors; (iii) mounting hardware or devices; (iv) computerhardware including, for example, processor, memory; (v) input/outputports; (vi) speaker/microphone; (vii) state selectors; (viii) video/LEDscreen graphical interface; (ix) W-Fi/Bluetooth; (x) a power source; andthe like. Other components can help facilitate dissipation of heat suchas, for example a fan, F, and/or a heat sink, HS, as shown in FIG. 13B.

One of skill will appreciate that the design of the camera can include ahousing 1305 that facilitates heat dissipation by design. For example,the housing 1305 can be conductive and/or perforated, in someembodiments, to help facilitate the release of heat from the camera.

The cross-sectional diameter can be referred as the cross-sectionaldimension, of course, as the camera can be any shape, and one of skillwill appreciate that reducing the size of the camera is a reduction inthe maximum cross-sectional dimension required by the camera's design.The cross sectional dimension, in some embodiments, can be measured fromthe midpoint of the outer convex surface of one lens to the midpoint ofthe outer convex surface of the opposing lens, along the cross-sectionof the housing that connects those two points. In embodiments wherethere may be no opposing lens along the cross-section of the housing,then the cross-section can be measured from the midpoint of the outerconvex surface of one lens to the opposing outer surface of the housing,along the cross-section of the housing that connects those two points.In some embodiments, the maximum cross-sectional dimension of the cameracan range from about 10 mm to about 100 mm, from about 20 mm to about 80mm, from about 30 mm to about 70 mm, from about 40 mm to about 60 mm, orany range therein in increments of 1 mm. In some embodiments, themaximum cross-sectional dimension of the camera can range from about 10mm to about 100 mm, from about 20 mm to about 80 mm, from about 30 mm toabout 70 mm, from about 40 mm to about 60 mm, or any range therein inincrements of 1 mm. In some embodiments, the maximum cross-sectionaldimension of the housing can be, for example, about 3 mm, about 5 mm,about 7 mm, about 9 mm, about 11 mm, about 13 mm, about 15 mm, about 17mm, about 19 mm, about 21 mm, about 23 mm, about 25 mm, about 27 mm,about 29 mm, about 31 mm, about 33 mm, about 35 mm, about 37 mm, about39 mm, about 41 mm, about 43 mm, about 45 mm, about 47 mm, about 49 mm,about 51 mm, about 53 mm, about 55 mm, about 57 mm, about 59 mm, or anydiameter therein in increments of 1 mm.

Example 7. The Collection, Control, Transmission, and Sharing of ImageData

Since the camera is computerized, the collection, control, transmission,and sharing of image data can be done in a variety of ways, including ina network or in the cloud.

FIG. 14 shows how a network may be used for the system, according tosome embodiments. shows several computer systems coupled togetherthrough a network 1905, such as the internet, along with a cellularnetwork and related cellular devices. The term “internet” as used hereinrefers to a network of networks which uses certain protocols, such asthe TCP/IP protocol, and possibly other protocols such as the hypertexttransfer protocol (HTTP) for hypertext markup language (HTML) documentsthat make up the world wide web (web). The physical connections of theinternet and the protocols and communication procedures of the internetare well known to those of skill in the art.

Access to the internet 1905 is typically provided by internet serviceproviders (ISP), such as the ISPs 1910 and 1915. Users on clientsystems, such as client computer systems 1930, 1950, and 1960 obtainaccess to the internet through the internet service providers, such asISPs 1910 and 1915. Access to the internet allows users of the clientcomputer systems to exchange information, receive and send e-mails, andview documents, such as documents which have been prepared in the HTMLformat. These documents are often provided by web servers, such as webserver 1920 which is considered to be “on” the internet. Often these webservers are provided by the ISPs, such as ISP 1910, although a computersystem can be set up and connected to the internet without that systemalso being an ISP.

The web server 1920 is typically at least one computer system whichoperates as a server computer system and is configured to operate withthe protocols of the world wide web and is coupled to the internet.Optionally, the web server 1920 can be part of an ISP which providesaccess to the internet for client systems. The web server 1920 is showncoupled to the server computer system 1925 which itself is coupled toweb content 1995, which can be considered a form of a media database.While two computer systems 1920 and 1925 are shown, the web serversystem 1920 and the server computer system 1925 can be one computersystem having different software components providing the web serverfunctionality and the server functionality provided by the servercomputer system 1925 which will be described further below.

Cellular network interface 1943 provides an interface between a cellularnetwork and corresponding cellular devices 1944, 1946 and 1948 on oneside, and network 1905 on the other side. Thus cellular devices 1944,1946 and 1948, which may be personal devices including cellulartelephones, two-way pagers, personal digital assistants or other similardevices, may connect with network 1905 and exchange information such asemail, content, or HTTP-formatted data, for example. Cellular networkinterface 1943 is coupled to computer 1940, which communicates withnetwork 1905 through modem interface 1945. Computer 1940 may be apersonal computer, server computer or the like, and serves as a gateway.Thus, computer 1940 may be similar to client computers 1950 and 1960 orto gateway computer 1975, for example. Software or content may then beuploaded or downloaded through the connection provided by interface1943, computer 1940 and modem 1945.

Client computer systems 1930, 1950, and 1960 can each, with theappropriate web browsing software, view HTML pages provided by the webserver 1920. The ISP 1910 provides internet connectivity to the clientcomputer system 1930 through the modem interface 1935 which can beconsidered part of the client computer system 1930. The client computersystem can be a personal computer system, a network computer, a web TVsystem, or other such computer system.

Similarly, the ISP 1915 provides internet connectivity for clientsystems 1950 and 1960, although as shown, the connections are not thesame as for more directly connected computer systems. Client computersystems 1950 and 1960 are part of a LAN coupled through a gatewaycomputer 1975. While interfaces 1935 and 1945 are shown as genericallyas a “modem,” each of these interfaces can be an analog modem, isdnmodem, cable modem, satellite transmission interface (e.g. “direct PC”),or other interfaces for coupling a computer system to other computersystems.

Client computer systems 1950 and 1960 are coupled to a LAN 1970 throughnetwork interfaces 1955 and 1965, which can be Ethernet network or othernetwork interfaces. The LAN 1970 is also coupled to a gateway computersystem 1975 which can provide firewall and other internet relatedservices for the local area network. This gateway computer system 1975is coupled to the ISP 1915 to provide internet connectivity to theclient computer systems 1950 and 1960. The gateway computer system 1975can be a conventional server computer system. Also, the web serversystem 1920 can be a conventional server computer system.

Alternatively, a server computer system 1980 can be directly coupled tothe LAN 1970 through a network interface 1985 to provide files 1990 andother services to the clients 1950, 1960, without the need to connect tothe internet through the gateway system 1975.

Through the use of such a network, for example, the system can alsoprovide an element of social networking, in some embodiments, wherebyusers can contact other users having an interest in sharing the data andother relevant information, for example, on an intranet, internet, orcloud environment. In some embodiments, the system can include amessaging module operable to deliver notifications via email, SMS, andother mediums. In some embodiments, the system is accessible through aportable, single unit device and, in some embodiments, the input device,the graphical user interface, or both, is provided through a portable,single unit device. In some embodiments, the portable, single unitdevice is a hand-held device. In some embodiments, the systems andmethods can operate from the server to a user, from the user to aserver, from a user to a user, from a user to a plurality of users, inan MMO environment, from a user to a server to a user, from a server toa user (or plurality of users).

I claim:
 1. A method of creating a 360 degree camera as a single unitwith an integrated lighting array that is invisible to the camera whenacquiring a spherical image, the creating comprising: selecting ahousing for the camera, the housing configured to carry the integratedlighting array on the periphery of the housing; positioning a pluralityof lenses on the periphery of the housing to collect a respectiveplurality of imaging spaces that form the spherical image throughstitching, the plurality of lenses including a first lens on the firstouter surface to collect a first imaging space in the spherical imageand a second lens on the second outer surface to collect a secondimaging space in the spherical image; operably connecting a plurality ofimage sensors to the plurality of lenses, each of the plurality of imagesensors operably connected to a respective lens in the plurality oflenses, the operably connecting including placing a first image sensorin the housing behind the first lens and a second image sensor in thehousing behind the second lens; configuring each of the image sensorsfor operably connecting to a circuit that includes a processor and amemory on a non-transitory computer readable storage medium; and, apower source; defining a plurality of blind spaces, n, each of whichincludes a blind area on the housing, the plurality of blind spacesincluding a first blind space that is excluded from the plurality ofimaging spaces, the first blind space including a first blind area onthe housing; and, a second blind space that is excluded from theplurality of imaging spaces, the second blind space including a secondblind area on the housing; and, integrating a plurality of lightsources, n-x, where x ranges from 0 to (n−2), into the plurality ofblind spaces, the integrating including placing each light in theplurality of light sources in a respective blind space in the pluralityof blind spaces such that each light in the plurality of light sourcesis invisible to the camera when acquiring the plurality of imagingspaces, the placing including installing a first light source in thefirst blind area and a second light source in the second blind area;wherein, the camera functions to provide a desired amount of lightingfor the capture of the spherical image (i) without the plurality oflight sources being visible to the camera; and, (ii) without creatingshadows in the spherical image from the camera.
 2. The method of claim 1further comprising operably connecting the circuit that includes aprocessor and a memory on a non-transitory computer readable storagemedium to the image sensors.
 3. The method of claim 1 further comprisingoperably connecting the circuit that includes a processor and a memoryon a non-transitory computer readable storage medium to the imagesensors; and, a power source.
 4. The method of claim 1, wherein theselecting includes selecting the housing to be a 4-sided polyhedron. 5.The method of claim 1, wherein the selecting includes selecting thehousing to be a 6-sided polyhedron.
 6. The method of claim 1, whereinthe selecting includes selecting the housing to be a 8-sided polyhedron.7. The method of claim 1, wherein the selecting includes selecting thehousing to be a 12-sided polyhedron.
 8. The method of claim 1, whereinthe selecting includes selecting the housing to be a 20-sidedpolyhedron.
 9. The method of claim 1, wherein the selecting includesselecting the housing to be a cuboctahedron.
 10. The method of claim 1,wherein the selecting includes selecting the housing to be a snubcuboctahedron.
 11. The method of claim 1, wherein the selecting includesselecting the housing to be a cylinder.
 12. The method of claim 1,wherein the selecting includes selecting the housing to be a sphere. 13.A 360 degree camera having an integrated lighting array that isinvisible to the camera when acquiring a spherical image, the cameraincluding: a housing having a plurality of surfaces that includes atleast a first outer surface, and a second outer surface; a plurality oflenses on the housing, the plurality of lenses configured to collect aplurality of imaging spaces that are stitched together to form thespherical image, the plurality of lenses including at least a first lenson the first outer surface and a second lens on the second outersurface; wherein, the first lens is configured to obtain a first imagedata set corresponding to a first imaging space and the second lens isconfigured to obtain a second image data set corresponding to a secondimaging space; a plurality of image sensors in the housing, each of theplurality of image sensors configured for operably connecting to arespective lens in the plurality of lenses, the plurality of imagesensors including at least a first image sensor placed in the camerahousing behind the first lens and a second image sensor placed in thecamera housing behind the second lens; a circuit that includes aprocessor and a memory on a non-transitory computer readable storagemedium; and, a power source; a plurality of blind spaces, n, each ofwhich include a blind area on the housing, the plurality of blind spacesincluding at least (i) a first blind space that is at leastsubstantially excluded from the plurality of imaging spaces, the firstblind space including a first blind area on the housing; and, (ii) asecond blind space that is at least substantially excluded from theplurality of imaging spaces, the second blind space including a secondblind area also on the housing; a plurality of light sources, n-x, wherex ranges from 0 to (n−2), placed in the plurality of blind areas to beat least substantially invisible to the camera when acquiring thespherical image, the plurality of light sources including a first lightsource in the first blind area and a second light source in the secondblind area; wherein, the camera functions to provide a desired amount oflighting for the capture of the spherical image (i) without theplurality of light sources being visible to the camera; and, (ii)without creating shadows in the spherical image from the camera.
 14. Thecamera of claim 13 further comprising the circuit that includes aprocessor and a memory on a non-transitory computer readable storagemedium to the image sensor.
 15. The camera of claim 13 furthercomprising the circuit that includes a processor and a memory on anon-transitory computer readable storage medium to the image sensor;and, a power source.
 16. The camera of claim 13, wherein the housing isa 4-sided polyhedron.
 17. The camera of claim 13, wherein the housing isa 6-sided polyhedron.
 18. The camera of claim 13, wherein the housing isa 8-sided polyhedron.
 19. The camera of claim 13, wherein the housing isa 12-sided polyhedron.
 20. The camera of claim 13, wherein the housingis a 20-sided polyhedron.
 21. The camera of claim 13, wherein thehousing is a cuboctahedron.
 22. The camera of claim 13, wherein thehousing is a snub cuboctahedron.
 23. The camera of claim 13, wherein thehousing is a cylinder.
 24. The camera of claim 13, wherein the housingis a sphere.